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COMPUTER AIDED TEST PREPARATION 

[01] This application claims priority to United States provisional patent application 
serial number 60/307,150, filed on July 24, 2001. 

FIELD OF THE INVENTION 

[02] The invention relates to the field of test preparation. More particularly, the 
invention may be embodied in a method and system for weighting a response by a 
user to a test preparation question and readministering the question to the user 
based in part on the weighted response. 

BACKGROUND OF THE INVENTION 

[03] Throughout one's life, e.g., throughout the course of a student's academic career, 
or a businessperson's professional career, individuals are often required to take a 
variety of tests or exams for various reasons. For instance, high school students 
are often required to take a Scholastic Aptitude Test (SAT) or ACT Assessment 
(ACT) as part of the college application process. College students are often 
required take the GRE, MCAT, LSAT, or GMAT as part of the application 
procedure for a variety of types of graduate school studies. Adults, as part of their 
professional careers, must often take a professional exam to be allowed to pursue 
their chosen profession, for instance, a state bar exam to practice law in a given 
state, the patent bar exam to engage in practice with the United States Patent and 
Trademark Office (USPTO), or medical boards to practice medicine. 

[04] The examinations that an individual takes throughout his or her life may have a 
substantial impact on his or her career. For instance, individuals who score well 
on the LSAT tend to attend better law schools and obtain higher paying jobs than 
those who score lower on the LSAT. Likewise, the higher one's score on the 

1 



SAT, the better college to which one generally gets accepted. As such, there is 
often much pressure on an individual to do well on any particular exam. 

[05] To help individuals study for such tests, test preparation materials and classes are 
commercially available. For instance, an individual preparing for a test can buy a 
test preparation book, attend a preparation seminar, or buy computer software, 
among other things. Computer software typically administers to a user a series of 
sample test questions to help the user prepare for the actual exam. However, the 
software is lacking in that the software generally presents the user with a question, 
accepts the user's response, informs the user of the correctness of his or her 
answer and why, and then proceeds to the next question. When the program 
finishes all the questions, the program generally either terminates or starts over, 
readministering the user the entire set of questions. 

[06] Some known software programs record when a user answers a question correctly. 
After answering a question correctly, the program typically does not re-administer 
the same question because the user already knows the answer. However, when a 
user guesses the answer to a question and guesses correctly, the software typically 
assumes that the user knew the answer just as with any other question answered 
correctly. As such, the program generally does not readminister the correctly 
guessed question unless the software program is readministering all the questions 
in their entirety. 

[07] Thus, a test preparation software program is needed that can account for when a 
user is guessing answers to questions, and readministers questions to the user 
based whether the user guessed previously in response to the question. 

SUMMARY OF THE INVENTION 

[08] In a first aspect, the invention is embodied in a method for displaying test 
preparation questions to a user. A first question, to which a response is requested, 
is displayed on a computer display screen to a user. A weighted response to the 
first question is received from the user. When the user's response is correct, the 
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previous steps are repeated for the first question when the weight meets 
predetermined criteria. 



[09] In a second aspect, the invention is embodied in a computer system adapted to 
present test preparation questions to a user. There is a processor and a memory 
containing computer readable instruction. When the computer readable 
instructions are executed by the processor, the computer is caused to perform a set 
of steps. A first question, to which a response is requested, is displayed on a 
computer display screen to a user. A weighted response to the first question is 
received from the user. When the user's response is correct, the previous steps 
are repeated for the first question when the weight meets predetermined criteria. 

[10] In a third aspect, the invention is embodied in a computer readable medium on 
which computer readable instructions are stored such that, when executed by a 
computer, they cause the computer to perform a set of steps. A first question, to 
which a response is requested, is displayed on a computer display screen to a user. 
A weighted response to the first question is received from the user. When the 
user's response is correct, the previous steps are repeated for the first question 
when the weight meets predetermined criteria. 

DESCRIPTION OF THE DRAWINGS 

[11] Figure 1 is a block diagram of a computer system adapted according to an 
embodiment of the invention. 

[12] Figure 2 is an illustration of a computer display screen in a first embodiment of 
the invention. 

[13] Figure 3 is a flow chart of an embodiment of the invention. 

[14] Figure 4 is an illustration of a computer display screen in a second embodiment of 
the invention. 

DETAILED DESCRIPTION OF THE INVENTION 
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[15] In one embodiment, with reference to Fig. 1, the invention is embodied in a 
computer configured to present objective test preparation questions to a user 
preparing for a test, exam, or the like. An objective question is one to which the 
most correct response is one of a predetermined set of choices, for example, a 
conventional multiple choice question or true-false question. The computer 100 
has a processor 102, optional volatile memory 104, and non-volatile memory 106 
for storing application software 108 and a test question database 110. The 
database 1 10 contains sample questions used in preparation for an exam. As used 
herein, a question may be an actual question used on a previous exam, a question 
constructed exclusively for purposes of test preparation, or any other statement 
presented to a user to aid in test preparation, where the statement requires a 
response by the user. For instance, questions relating to patent practice may be 
h US ed in an embodiment of the invention directed to preparation for the patent bar 

rf exam. Sample questions are often available from the organization for which the 

m test is required, which in this example the Office of Enrollment and Discipline at 

5 the USPTO or other government agency responsible for administering the exam. 

U [16] In a first embodiment of the invention, as well as selecting a response to a 

question, the user also selects a weight, or confidence level, associated with the 
3 user's response to the question. For instance, in one embodiment, as shown in 

S Fig. 2, a user selects one of two confidence levels. The first confidence level is 

that the user is sure his or her selected response is correct. The second confidence 
level is that the user is not sure that his or her selected response is correct. After 
submitting the weighted response, the program continues to operate based in part 
of the weight. 

[17] In this embodiment, application software may be configured to cause a computer 
to perform the steps shown in Fig. 3. In step 301, a question is picked from the 
set of possible questions to present to the user. Initially, this set may be the entire 
set of questions in the database 110, or some subset thereof. In step 303, the 
selected question is presented on the computer display screen to the user. In 
response to the question, the user, in step 305, selects a response to the question. 
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In step 310 the user selects a weight associated with the response, where the 
weight may represent the user's confidence in the correctness of his or her 
answer. The weighted response is submitted in step 315. The system determines 
whether the response is correct in step 320. If the response is incorrect, the 
system checks in step 335 whether there are any questions left in the question set 
to present to the user. If so, the system returns to step 301. In this manner, the 
question that the user answered incorrectly remains in the set of possible 
questions, and thus the user may eventually be prompted again with the same 
question. 

[18] If the response is correct the system checks, in step 325, the user's confidence 
level in his or her response. If the user was unsure of his or her response, the 
system proceeds to step 335. If the user was sure of his or her response, the 
system marks the question to be removed from the question set in step 330. The 
system then proceeds to step 335, where it will determine whether there are any 
questions left in the question set. If so, the system proceeds to step 301 and 
selects a question from the remaining questions, and continues the process until 
no question remain in the question set. Optionally (not shown), upon successfully 
depleting the question set, a congratulatory message may be displayed on the 
computer display screen, informing the user that he or she has successfully 
completed the question set in preparation for the exam. 

[19] In some embodiments the system proceeds through the entire question set before 
repeating any questions. In other embodiments, the system may choose randomly 
from the entire set of questions such that it is possible that a question may be 
repeated before the user has seen every distinct question. 

[20] In another embodiment of the invention, as shown in Fig. 4, more than two 
confidence levels may be used. In this embodiment, one question may be 
presented to the user more often than another question, depending on the user's 
confidence level when responding to each question. The number of times a 
question is redisplayed to the user may be proportional to the user's confidence 
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level during his or her initial response to the question. For instance, a question 
that a user responds to with a twenty-five percent confidence level may be 
subsequently presented to a user three times as often as a question to which the 
user responded with a seventy-five percent confidence level, even when the user 
responds correctly to each question. 

[21] When a question is redisplayed to the user after the user's initial weighted 
response to the question, the user selects a second response and a second weight 
associated with the second response. The second response may or may not be the 
same as the user's initial response, just as the second weight may or may not be 
the same as the user's initial weight selected for that question. The most recently 
selected weight may be used to determine the frequency with which the question 
is redisplayed. In another embodiment, all of the user's selected weights for a 
question are averaged together, and the average weight may be used to determine 
the frequency with which the question is redisplayed. In still another 
embodiment, the most recent n weights submitted with the most recent n 
responses to a question are averaged together, where n is an integer value greater 
than zero. The average of the most recent n weights may then be used to 
determine the frequency with which the question is redisplayed. In another 
embodiment, the confidence level percentage may be used as a weight for 
selecting which question to redisplay. That is, those questions with higher 
confidence levels may be readministered less frequently than those with low 
confidence levels. 

[22] In one embodiment of the invention, a time of response may be used as an 
indicator of the user's confidence level, without having to affirmatively ask the 
user his or her confidence level with respect to a question's response. Because it 
is readily ascertainable how much time an average person takes to read a question 
of a known length, the amount of time taken to respond to the question beyond the 
amount of time it generally takes to read the question can be used as a measure of 
the user's confidence level. For example, it may take an average person twenty to 
twenty-five seconds to read a short questions of about fifty words, including five 
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short answer choices of one to two words each. If the user correctly responds to 
the question within about thirty seconds, it may be inferred that the user was not 
guessing. However, if the user correctly responds to the question but takes over 
one minute to do so, the test preparation software may infer that the user guessed 
in response to the question, even though the user answered the question correctly. 

While the invention has been described with respect to specific examples 
including presently preferred modes of carrying out the invention, those skilled in 
the art will appreciate that there are numerous variations and permutations of the 
above described systems and techniques that fall within the spirit and scope of the 
invention as set forth in the appended claims. 



